Skip to content

Conversation

gregkalapos
Copy link
Contributor

@gregkalapos gregkalapos commented Mar 25, 2025

Adding mapping for profiling <-> traces integration for OTel data.

cc @rockdaboot

@gregkalapos gregkalapos self-assigned this Mar 25, 2025
@gregkalapos gregkalapos requested a review from a team as a code owner March 25, 2025 18:45
@elasticsearchmachine elasticsearchmachine added v9.1.0 needs:triage Requires assignment of a team area label external-contributor Pull request authored by a developer outside the Elasticsearch team labels Mar 25, 2025
@gregkalapos gregkalapos added the :Data Management/Data streams Data streams and their lifecycles label Mar 25, 2025
@elasticsearchmachine elasticsearchmachine added the Team:Data Management Meta label for data/management team label Mar 25, 2025
@elasticsearchmachine
Copy link
Collaborator

Pinging @elastic/es-data-management (Team:Data Management)

@elasticsearchmachine elasticsearchmachine removed the needs:triage Requires assignment of a team area label label Mar 25, 2025
@rockdaboot
Copy link
Contributor

Are there already docs for counted_keyword? I still run into #115964 (counted_keyword field type needs docs).

@rockdaboot
Copy link
Contributor

Are there already docs for counted_keyword? I still run into #115964 (counted_keyword field type needs docs).

Just found a description at

* <p>A special field mapper for multi-valued keywords that may contain duplicate values. If the associated <code>counted_terms</code>

@gregkalapos
Copy link
Contributor Author

Right - and maybe the PR itself: #101826

But I don't find normal docs either.

@gregkalapos
Copy link
Contributor Author

As discussed in the overall issue, changed the field we map to elastic.profiler_stack_trace_ids and opened a PR in Kibana to handle it: elastic/kibana#216819. With this, we avoid transforming the field in the collector - instead we store it as is.

@gregkalapos gregkalapos enabled auto-merge (squash) April 4, 2025 08:11
@gregkalapos gregkalapos merged commit 88996bc into elastic:main Apr 4, 2025
16 of 17 checks passed
andreidan pushed a commit to andreidan/elasticsearch that referenced this pull request Apr 9, 2025
…ata mappings (elastic#125608)

* Add profiler_stack_trace_ids as counted_keyword to otel-data mappings

* Change prefix for profiler_stack_trace_ids
cauemarcondes added a commit to elastic/kibana that referenced this pull request Apr 14, 2025
…tion (#217020)

Depends on elastic/elasticsearch#125608

# Summary

`ELASTIC_PROFILER_STACK_TRACE_IDS` is introduced for OTel based data
streams. The same information is stored in
`TRANSACTION_PROFILER_STACK_TRACE_IDS` in the classic APM data streams.

Prior to this PR apm<->profiling integration did not work for OTel SDKs.
This PR adds handling for the new field name.

<img width="1159" alt="Screenshot 2025-04-03 at 10 05 28"
src="https://github.com/user-attachments/assets/ce3ad092-d4f4-4a16-843e-923c72938fe1"
/>

<img width="1772" alt="Screenshot 2025-04-03 at 10 05 40"
src="https://github.com/user-attachments/assets/8b2682fe-6f2e-49a4-9995-d83997a05f02"
/>

---------

Co-authored-by: Greg Kalapos <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

:Data Management/Data streams Data streams and their lifecycles external-contributor Pull request authored by a developer outside the Elasticsearch team >non-issue Team:Data Management Meta label for data/management team v9.1.0

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants